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DETAILED ACTION 



Information Disclosure Statement 

1 . The information disclosure statement (IDS) submitted on 1 0/21/2003 is in 
compliance with the provisions of 37 CFR 1.97. Accordingly, the information disclosure 
statement is being considered by the examiner 

Specification 

2. The disclosure is objected to because of the following informalities: 

In the second paragraph of specification, it appears that wrong U.S. patent 
numbers are listed. The U.S. patent No. 5,764,535 and 6,275.269 appears to be 
mistakenly listed to mean U.S. patent No. 5,764,770 and 6,275,260, respectively. 

Appropriate correction is required. 

Claim Objections 

3. Claim 22 is objected to because of recitation of "; and;" which should be 
corrected to read as - ; and Appropriate correction is required. 



Claim Rejections - 35 USC § 101 

35 U.S.C. 101 reads as follows: 



Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 
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4. Claims 20 & 21 are rejected under 35 U.S.C. 101 because the claimed invention 
Is directed to non-statutory subject matter. 

Each of claims 20 and 21 recites "A computer-readable medium having a 
program." As apparently seen in the claim language, the claimed "a program" is not 
stored , encoded or embodied in the computer-readable medium. Specifically, the 
limitation "having" is not necessarily storing, encoding or embodying. Furthermore, the 
limitation "a program" is not necessarily a computer program. Each of claims 20 & 21 
does not define structural and functional interrelationships between a computer program 
and the rest of the computer which permit the computer program's functionality to be 
realized and is therefore directed to non-statutory subject matter. 

Claim Rejections - 35 USC § 102 
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

5. Claims 1,4-6,8-12.14-18, 20-22 are rejected under 35 U.S.C. 1 02(b) as being 
anticipated by Berstis (US 6,337,688). 

Regarding claim 1, Berstis discloses a video system (Figs. 1 & 2) comprising: 
an image capture system (video camera 12) configured to capture a plurality of 
frames of a video clip (col. 3, lines 1-10 and col. 5, lines 45-63); 
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a sequence data generating system (Figs. 2 & 4) for generating data indicative of 
frame position of each of the plurality of frames (see col. 3, lines 42-63 and col. 5, lines 
48-63, wherein frame position of each of the video frames is indicated by the position of 
the camera sensed by the position and orientation sensor 34. or the frame position 
reads on the frame number); 

an orientation sensor (34) configured to provide orientation information for each 
of the plurality of frames at the time each frame is captured (Figs. 2 & 4; col. 3, lines 49- 
63); 

a processor (30) configured to incorporate the orientation information and 
sequence data into each frame (Figs. 2 & 4; col. 5, lines 48-53). 

Regarding claim 4, Berstis also discloses a display (18) configured to display 
each frame using the orientation information, such that the displayed frame is oriented 
the same as an orientation of the image capture system when the frame was captured 
(see Figs. 5 & 7; col. 6, lines 2-12 and col. 7, line 66 - col. 8, line 40, and note that each 
frame is displayed in the same orientation as it was captured to create a virtual 3-D 
video along the paths A, B, C, D and so on). 

Regarding claim 5, this method claim is also met by the analysis of apparatus 
claim 1. 



Application/Control Number: 10/690,194 Page 5 

Art Unit: 2622 

Regarding claim 6, it is also clear in Berstis that the steps of claim 6 are repeated 
to capture a plurality of serially sequenced frames corresponding to the video clip (see 
col. 5, line 45 - col. 6, line 12). 

Regarding claim 8, Berstis further discloses that the step of incorporating the 
orientation information comprises incorporating the orientation information into the 
frame as a file (col. 5, lines 48-60). 

Regarding claim 9, Berstis further discloses that the step of incorporating the 
orientation information comprises incorporating the orientation information into the 
image data (col. 5, lines 53-57). 

Regarding claim 10, as clearly disclosed in Figs. 2 & 4 and col. 5, lines 48-53, a 
step of saving the frame into a . memory (32) comprising a plurality of serially sequenced 
frames corresponding to the video clip. 

Regarding claim 1 1 , Berstis discloses a method for displaying a frame of a video 
clip (Fig. 8), the method comprising the steps of: 

receiving the frame having at least image data and sequence data corresponding 
to an image captured by an image capture device (col. 7, line 66 - col. 8, line 40); 

receiving orientation information residing in the frame; determining an orientation 
of the frame, the orientation of the frame corresponding to the orientation of the image 
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capture device at the time the image was captured; and displaying the frame oriented in 
accordance with the determined orientation (col. 7, line 66 - col. 8, line 40, wherein the 
captured frames are displayed in the same orientation as they were captured when the 
user inputs a command to view virtual 3-D video from point A to point L of the interior of 
a building as illustrated in Fig. 5). 

Regarding claim 12, as the user selects point B shown in Fig. 5, a frame from a 
plurality of serially sequenced frames corresponding to the video clip at point B is 
selected for displaying (col. 8, lines 30-40). 

Regarding claim 14, it is clearly seen in col. 7, line 66 - col. 8, line 40 that the 
frame is retrieved from a memory (32) to generate the virtual 3-D video. 

Regarding claim 15, Berstis further discloses the steps of: communicating the 
frame from an image capture device (video camera 12) to a processing device 
(computer 6 shown in Fig. 1); and displaying the frame on a display (18) coupled to the 
processing device (col. 2, lines 50-67). 

Regarding claim 16, see the analysis of claim 15 in which display 18 is coupled 
to the camera via communication line 8 (Fig. 1).* Furthermore, the frame can be 
displayed (not necessarily to be displayed in the same orientation as it was captured) on 
the LCD attached to the camera (col. 4, lines 1-5). 
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Regarding claim 17, Berstls discloses a system for providing orientation 
information for frames of a video clip (Fig. 1), comprising: 

means (optical input/image sensor 42) for capturing an image (Fig. 2; col. 3, lines 

1-10); 

means (combined 42 and 30) for generating a frame having at least image data 
corresponding to the captured image and sequence data (i.e., frame number), wherein 
the frame is one of a plurality of serially sequenced frames corresponding to the video 
clip (Figs. 2 & 4 and col. 5, lines 45-63); 

means (34) for sensing an orientation of an image capture device at the time the 
image is captured (col. 3, lines 49-63) ; 

means (30) for incorporating the orientation into the frame (col. 5, lines 45-63); 

means (32) for storing the frame with the orientation in a memory (col. 5, lines 
45-57). 

Regarding claim 18, also disclosed by Berstis is a means for generating 
orientation infomnation from the orientation of the image capture device such that the 
orientation information is incorporated into the frame (col. 5, lines 45-57). 

Regarding claims 20 & 21 , these program claims are also met by the analyses of 
method claims 11, 14, 5 and 6 realized by a program stored in a computer-readable 
medium (i.e., CD-ROM, hard disk, etc. ). See col. 9, lines 54-60. 
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Regarding claim 22, Berstis discloses a video clip (col. 3, lines 1-10) comprising: 
a first frame comprising image data, video sequence data (i.e., frame number) 
and image orientation data (col. 5, lines 45-63); and a second frame (another frame in 
the video sequence) comprising second image data, second video sequence data (i.e., 
a subsequent frame number) and second image orientation data (col. 5, lines 45-63), 
the second frame serially sequenced immediately behind the first frame (this is inherent 
as sequence of video frames captured by the video camera 12 in time sequence as 
disclosed in col. 3, lines 1-10). 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

6. Claims 2, 3, 7, 13 & 19 are rejected under 35 U.S.C. 103(a) as being 

unpatentable over Berstis (US 6,337.688) in view of Parulski et al. (US 5,900,909). 

Regarding claim 2, although Berstis teaches that the orientation information is 
incorporated with each image frame (col. 5, lines 48-57), Berstis is silent about that the 
orientation information resides in a frame header of each frame. However, as taught by 
Parulski, it is well known in the art that the orientation code of an image is stored in the 
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frame header of an image so that the image orientation is quickly detected during 
playback for rotating the displayed image to the same orientation as it was captured 
(see Parulski, Fig. 6 and col. 5, lines 40-56). 

Therefore, It would have been obvious to one of ordinary skill in the art to 
configure the video system of Berstis to store the orientation information in a frame 
header of each frame so that the orientation information would be quickly retrieved 
during playback. 

Regarding claim 3, it is also seen in the combined teaching of Berstis and 
Parulski that a memory is configured to receive each frame wherein the orientation 
information resides (see Berstis, col. 5, lines 48-57 and the analysis of claim 2). 

Regarding claims 7, 1 3 & 19, these claims are also met by the analyses of claims 
2 & 3 above. 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Nhan T. Iran whose telephone number is (571) 272- 
7371. The examiner can normally be reached on Monday - Friday, 8:0Gam - 4:30pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, David Ometz can be reached on (571) 272-7593. The fax phone number for 
the organization where this application or proceeding Is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 




NHAN T. IRAN 
Patent Examiner 



